Some Pathological Regression Asymptotics under Stable Conditions
نویسندگان
چکیده
We consider a simple through-the-origin linear regression example introduced by Rousseeuw, van Aelst and Hubert (1999). It is shown that the conventional least squares and least absolute error estimators converge in distribution without normalization and consequently are inconsistent. A class of weighted median regression estimators, including the maximum depth estimator of Rousseeuw and Hubert (1999), are shown to converge at rate n. Finally, the maximum likelihood estimator is considered, and we observe that there exist estimators that converge at rate n. The results illustrate some interesting, albeit somewhat pathological, aspects of stable-law convergence.
منابع مشابه
Asymptotics for Lasso - Type Estimators
We consider the asymptotic behavior of regression estimators that minimize the residual sum of squares plus a penalty proportional to ∑ βj γ for some γ > 0. These estimators include the Lasso as a special case when γ = 1. Under appropriate conditions, we show that the limiting distributions can have positive probability mass at 0 when the true value of the parameter is 0. We also consider asymp...
متن کاملAsymptotics of the Density of the Supremum of a Random Walk with Heavy-tailed Increments
Under some relaxed conditions, in this paper we obtain some equivalent conditions on the asymptotics of the density of the supremum of a random walk with heavy-tailed increments. To do this, we investigate the asymptotics of the first ascending ladder height of a randomwalk with heavy-tailed increments. The results obtained improve and extend the corresponding classical results.
متن کاملTransient Asymptotics of Lévy-driven Queues
With (Qt )t denoting the stationary workload process in a queue fed by a Lévy input process (Xt )t , this paper focuses on the asymptotics of rare event probabilities of the type P(Q0 > pB, QTB > qB) for given positive numbers p and q, and a positive deterministic function TB . We first identify conditions under which the probability of interest is dominated by the ‘most demanding event’, in th...
متن کاملAsymptotics for polynomial spline regression under weak conditions
We derive rate of convergence for spline regression under weak conditions. The results improve upon those in Huang (Ann. Statist. 26 (1998a) 242) in two ways. Firstly, results are obtained under less stringent conditions on the growing rate of the number of knots. Secondly, L2 approximation instead of L∞ approximation by splines are used to bound the rate of convergence, this allows us to obtai...
متن کاملExponential asymptotics for intersection local times of stable processes and random walks
We study large deviations for intersection local times of p independent d-dimensional symmetric stable processes of index β, under the condition p(d − β) < d. Our approach is based on FeynmanKac type large deviations, moment computations and some techniques from probability in Banach spaces.
متن کامل